Fluctuation-Dissipation theorems and entropy production in relaxational systems 
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We show that for stochastic dynamical systems out of equilibrium the violation of the fluctuation- 
dissipation equality is bounded by a function of the entropy production. The result applies to 
a much wider situation than 'near equilibrium', comprising diffusion as well as glasses and other 
macroscopic systems far from equilibrium. For aging systems this bounds the age-frequency regimes 
in which the susceptibilities satisfy FDT in terms of the rate of decay of the i?-function, a question 
intimately related to the reading of a thermometer placed in contact with the system. 
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Many systems encountered in Nature have slow dy- 
namics but are not 'near equilibrium' in any obvious 
sense. Typical examples are (i) Glassy systems long time 
after the preparation procedure has finished, e.g. long af- 
ter a temperature quench, (ii) Domain growth and phase 
separation, (iii) Systems that can be kept 'far' from 
equilibrium by a small external power input done by sta- 
tionary non-conservative forces and/or periodically time- 
dependent forces, (iv) Diffusion in non-compact spaces. 

A slow, persistent, out of equilibrium regime is possi- 
ble because in the thermodynamic limit the ergodic time 
is very large compared to the experimental time scales 
— this is the case of the first three examples — or due to 
the abscence of confining potentials in the case of diffu- 
sion. Indeed, in contrast with the usually studied situa- 
tion iQ,^ , none of the cases we mentioned can be viewed 
as a small perturbation about equilibrium such that the 
systems would return quickly to equilibrium as soon as 
the perturbation is removed. 

Moreover, these systems may not be regarded in gen- 
eral as 'metastable'. Specifically, one cannot consider a 
glass or a system undergoing domain growth to be com- 
pletely equilibrated within a fixed sector of phase-space, 
as in the case of e.g. diamond, because the probability 
distribution in phase-space changes continually. Indeed, 
by measuring two-time correlation or response functions 
one can at any time determine the age of a glass . 

Bearing this in mind, a relevant question is whether 
some specifically equilibrium properties are also present 
in these systems. In this paper we concentrate on the 
study of the fluctuation-dissipation theorem (of the 'first 
kind', FDT Q). A physical interpretation of this FDT is 
that its validity is a necessary condition for a thermome- 
ter in contact only with the system to register the bath's 
temperature [|o). 

Working with dissipative dynamics, we show that the 
violations of the fluctuation-dissipation equalities vanish 
with a quantity that can be identified with the entropy 
production rate. 

This leads us to suggest that there are unifying fea- 



tures in situations with small entropy production rate, 
whatever its origin (aging, work done by non-conservative 
and/or time-dependent forces, temperature gradients, 
etc). This comprises a much wider class of systems than 
the conventionally studied linear regime. 

Let C(i, t') — {A{t)B{t')) be a correlation between ob- 
servables A and B, R{t, t') = 6{A{t)) /5h{t')\h=Q the asso- 
ciated response to a field conjugate to B, and x(^7^') = 
/j, R{t, s)ds the integrated response. The 'differential' 
violation V of FDT at {t,t') is 



TR^ {\-X{t,t')) 



dC{t,t') 
dt' 



(1) 



which also defines the 'fluctuation-dissipation ratio' 
X{t, t') 0. Here, and in what follows, t > t' . A stronger 
and more physical form of the violation is the integrated 
version J(i, t') = J^, V{t, s)ds: 



I{t,t')^C{t,t)-C{t,t')-Tx{t,t') 



(2) 



The static (zero-frequency) violation is 1^=^^ = 
limt_,oo I(t, t'). We can now be more precise about what 
is meant by 'far' from equilibrium. In the systems we con- 
sider, I{t, t') is (very) different from zero for certain large 
t, t' even in the limit of vanishing entropy production and, 
in particular, static susceptibilities do not coincide with 
their equilibrium value (/'^=° ^ 0) [§|Jll|,|l|. 

We assume a Langevin dynamics with an inertial term 



mxi 



(3) 



where i = l,...,iV. fi are velocity- independent non- 
conservative or time-dependent forces. F^ is a delta- 
correlated white noise with variance 2^T. This relation 
between the friction coefficient and the noise-correlation 
is the 'fluctuation -dissipation relation' (or FDT of the 
'second kind'); it expresses the fact that the bath itself is 
and stays in equilibrium. We encode Xi in an A^-vector 
X. For simplicity, we have set the Boltzmann constant 
fcs = 1 and all masses rui to be equal to m. We briefly de- 
scribe the massless case at the end of the letter. We shall 
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not consider purely Hamiltonian systems with 7 = 0, for 
reasons which will become evident. 

The probability distribution at time t for the process 
is given by P{x,v,t) = Texp(/^ Lk)P{x,v,0) with 
T denoting time-ordering and Lk the Kramers operator 
given by Q: 

1 T 

Lk = -dxiVi H ^y^{Jv^ + d^^E + /, + 7— (4) 

m m 

where we have used the summation convention. An H- 
function may be defined as |4U 



(5) 



H{t) = / dxdvP TlnP + E{x) 



and may be interpreted as a 'generalized free-energy'. 

Using the equation for P and some integrations by 
parts one finds 



Hit)^-{fit)-vit))-J2g,it) 



(6) 



where the first term is the power done by the forces / 
and Qi are the entropy production terms 

gi{t)^-f dxdv 2— >0. (7) 

J rw'P 

Equations (^) and ^ imply that in the purely relax- 
ational / = case with bounded energy, H{t) is mono- 
tonically decreasing (and constant if 7 = — Liouville's 
theorem for Hamiltonian dynamics) and its time deriva- 
tive must tend to zero since the equilibrium free energy is 
finite. They also imply that a stationary {H = 0) driven 
system does negative external work on average. 

We describe below a number of situations in which the 
differential FDT-violation V vanishes and the integral 
FDT-violation /, which can be finite, takes a restricted 
form: 

(i) Purely relaxational systems |^ as the total entropy 
production rate tends to zero when t' ^ 00. This can 
be satisfied in two ways, depending on the large-times 
sector we consider. For infinitely separated times, 'ag- 
ing regime', one may have X{t,t') ^ 1 and dt'C 

0. Instead, in the regime of smaller time-separations 
X(t,t') 1 and dt'C ^ (more hke ordinary FDT). 
We also show that the asymptotic rate of decay of H{t) 
determines the extent of both regimes. 

(ii) Stationary driven systems with H = Q in the limit 
of small driving power (/ • f) — > 0. For time-separations 
that are larger for smaller driving powers one can have 
V{t-t') ^ withX(<-t') ^ 1 &nAdt>C{t-t') 0, 
while for time-differences that remain finite in the weak 
driving limit V{t - t') ^ Q with X{t,t') 1 and 
dt'C{t-t')^0. 

(iii) Periodically driven systems of period r that have 
achieved a stationary (period r) regime |lq] in the limit 



of vanishing work per cycle. The FDT-violation over a 

cycle J^, dsV{t, s) vanishes with J^, '^^ ds{f{s) ■ v{s)). 

In these three cases X can be different from one pre- 
cisely for pairs of times such that the correlation evolves 
slowly. The fact that for large, widely separated times 
one can (and often does 0) have X 1 is crucial, be- 
cause it ultimately leads to the violation of the integral 
form of FDT: I{t,t') ^ in certain large time sectors, 
(iv) Diffusion (with or without non-conservative forces) 
]l6t for times such that the root mean squared displace- 
ment at later time t times the entropy production rate 
at the earlier time t' vanishes. 

Derivation. 

We prove the result for macroscopic correlations and 
responses constructed as follows. Let {^^(a;)} and 
{Bi{x)} be two sets of operators. We assume that 
each Ai [Bi) only depends upon the subset (Cf ) 
of the degrees of freedom of the system. We denote 
CAi,Bi{t,t') the correlation, RAi,Bi{t,t') the response 
of Ai to a field conjugate to Bi in the energy and 
VAi,Bi{t,t') = dt'CAi,Bi — TRAi,Bi the corresponding 
FDT-violation. We calculate the total FDT-violation 
VAB{t,t') associated with NCab = CAi,Bi and 

NRab=Y.'^ Ra^^b,. 

Using Eq.(0), one can easily show that 



VA^^Ai^t') ^^S{l,i) I dxdvdx'dv'A,{x') 
xP{x',v',t\x,v,t')d,,B,{x) (J-d,,+vi^ P{x,v,t') (8) 

where P{x' ,v' ,t\x,v,t') = {x' ,v'\Te'^t' \x,v) . We 
have made explicit the non-zero terms by introducing 
6(1, i) = 1 if Z S Cf and zero otherwise. 

Identifying each term on the right as {^nl'^n) = 
J dxdvdx'dv'^ii'^ii with 

= A,{x')P'/\x',v',t\x,v,t')P'^\x,v,t')d^^B,{x) 

and using the Cauchy-Scwhartz inequality < 
V {^u\^ii){'i'ii\'^ii) one can bound separately each inte- 
gral in (||) as 

< {Aj{t){d.,,B,f{t')Y'^g]'\t')e{l,i) (9) 

with gi{t') given by Eq.(0). 

The 'macroscopic' FDT-violation is 



NVAB{t, t') = 



Y.VA..B.it.t'] 



(10) 



The Cauchy-Schwartz inequality applied on the sum 
yields 
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NVAB{t,t') <Y,\{'^^l\'i'^ 



< VNDAB(.t,t')i^gi,it')eil',i') 



1/2 



(11) 



, i'l' 



where we have defined Dab through 
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NDAB{t,t')^ [J2{A^(.t)id.,,B,fit'))eil,z) 



The last factor is 9i'it') E^' , «') = Ei' 9i'{i')^i'. 
where A//' is the number of different Ai^ that depend on 
xi' . Assuming all the A// to be finite, we can again bound 
the last factor using Mi < N = max/ Mi . If in addition 
Cf has a finite number of elements, Dab is 0[1). Thus 



(12) 



VAB{t,t') < VMDABit 




Both sides of the inequality are 0(1). This is the basic 
result of this letter. We shall explore its consequences 
below. 

For a purely relaxational system, this yields: 



VAB{t,t') < VMDABit, t') 



1 dH{t'] 
jN dt' 
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(13) 



Note that this proof breaks down in the non-dissipative 
limit 7 = 0. 

For stationary non-conservative systems we have 



VAB{t-t') < VMDABit -t') 



v f 

N 
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(14) 



while for a 'stationary' periodically driven system such 
that H{t) = H{t + T): 



J dsVAB{t,s) < iM J dsD\g{t,s) 



'n 



W(t') = /j* ds{v{s) ■ f{s)) is the work per period. 

These results can be generalized to establish a relation 
for multiple point correlations between operators Af de- 
pending on the coordinates in C; at times ti > ... > tk, 
C^'---'^ = (A^ ...^f), and the corresponding responses 



R 



to a perturbation applied to Af at time tk- 



Applications 

As a particular simple case of Eq. (p^) we obtain a 
bound for the variation of a single-time quantity in a 
relaxational case. Setting Ai = I and taking a single 
operator B, Rab = and we obtain 



d{B) 



dt 



N 



1/2 



< 



1 dH{t) V''^ 
'l dt J 



(15) 



Another typical application of the formulae above is 
when lattice variables, with i denoting the site. 

The fluctuation-dissipation theorem associated with the 
two-point correlation C{r,t,t') and response R{r,t,t') is 
obtained by putting Bi = Xi and Ai = Xi+r- Similarly, 
one can study the energy-energy correlations C^{r,t,t') 
with Bi = Ei — (Ei) and Ai = Si+r — {Ei+r), provided 
that the energy of a site depends on a finite number of 
neighbours (and hence M is finite) . 

One can extend the derivation to the calculation of to- 
tal correlations if the corresponding spatial dependencies 
fall fast enough. For example, for the energy: 

^{E{t)E{t')) - ^{E{t)){E{t')) ^Y.C^^r,^^^') (16) 

r 

one can use the bounds obtained previously provided one 
can cut off the sum at some maximum distance rmax- 

Another interesting bound is obtained by writing 
{f{x) ■v)=f dxdvf{x) ■ {v + Tdv)P and by proceeding 
as from Eq.(|) to Eq.(^: 



{f-v)'<{\f\')Y,g, 



(17) 



Integrated bounds for purely relaxational systems 

In glassy systems it is known that the integral 

form of FDT is violated in certain two (large) time sec- 
tors. We can bound the extent of these sectors as follows. 

Assuming that the factor Dab is finite for all times, 
DAB(t,t') < K, on integrating (|l3|) and applying once 
again Cauchy-Schwartz, we obtain 



\lAB{t,t')\<K 



1 dH{s) 
'N ds 
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ds 



where lAB{t,t') = CAB{t,t) - CAB{t,t') - TxAB{t,t'). 
Hence, there can be no integral violation of FDT for 
any long times if H falls faster than . Interestingly 
enough, if H(t) can be written as an average over expo- 
nential processes H{t) = J dTp{T)exp{—t/T), this result 
implies that there can be FDT violation at large times 
only if (r) diverges 

For H falling slower than or as t~^, we can still bound 
the region in which FDT holds. First of all, we have that 
for t' ^ oo and t-t' = 0(1) FDT will always hold. More 
generally, consider the limit t' ^ co with t — t' — 0{t'°') 
with < a < 1. A simple calculation gives 



\lAB{t,t')\<K(- 



1 dH{t') 
N dt' 
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liH{t) = Hoo+kt-°', then there wiU be no FDT violation 
in the time sectors defined by a provided 2a < (a + l). In 
particular, if H falls as any inverse power of a logarithm, 
FDT holds for t ~ t' < 0{t'^^^). 
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Massless case 

One can treat the case with m = {i.e. without iner- 
tial term) in the same way. One defines an H function as 
in without the kinetic term and with P{x, t) depend- 
ing only on space. Using the Fokker-Planck equation, one 
may derive an expression for the fluctuation-dissipation 
violation analogous to (H), which can be bounded in 
terms of the entropy production, which in this case reads: 



3< 



dx 



{Pd^,E{x)+Td^,Pf 
P 



> 



(18) 



Diffusion 

A simple application of the massless case is to Brown- 
ian motion in D dimensions, if we set the diffusion con- 
stant to be equal to a temperature T, and take Ai — Xi 
and Bi = Xi The application of the inequality for the 
massless case yields 

\V{t,t')\ < {2DTtf'^ {TD/{2t')f''^ ^TDit/t'f^ . 

Note that here DAB{t,t') — 2Dt and is therefore not 
bounded. Since in this case neither R nor dt'C are small, 
this equation tells us that FDT can be violated jl^ . The 
exact calculation gives V{t, t') = TD, hence the inequal- 
ity is clearly obeyed but with equality only at t = t' . 

A more interesting example of the applications of our 
study is to the problem of Sinai diffusion in one dimension 
p9| , p^j20| . If one assumes that H{t) scales in the same 
way as the energy E{t), then one may deduce the scaling 
of the energy via the Arrhenius law t ~ tq exp{cE{Xt)) , 
with c and tq constants and • representing an average 
over disorder. In this problem the particle is subject to a 
white noise force and therefore is diffusing in a Brownian 
potential, hence E{x) ~ x^/^. From this one deduces 
the results (X^) - log^{t) and H{t) ~ 'E^ - log(t) 
(where we emphasize the relation between E and H is 
only justified on the grounds of physical intuition). We 
therefore obtain |T^(t,t')| < clog^{t)/V¥, which implies 
that the integrated form of FDT must hold at least up 
to time differences scaling as t ~ t' ^ ct 



,1/2 



In conclusion we have shown that there is a direct 
connection between FDT-violations and entropy produc- 
tion in systems with stochastic dynamics. This connec- 
tion allows to obtain results even in the interesting cases 
in which in the limit of small entropy production the 
systems are still far from equilibrium, as may happen 
in macroscopic (or diffusive) systems. It is important, 
though probably tougher, to extend these results to de- 
terministic systems with a thermostat |2|] in the ther- 
modynamic limit; it would be surprising if these results 
did not carry through to this case. 
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